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TECHNICAL APPENDIX 


- DESCRIPTION OF SAMPLE 


Educators 
Universe 


The universe-definition for each of the three sub-groups of 


educators was as follows: 


-- Secondary School Teachers--all Ontario public second- 
ary school teachers with one or more years of teaching 
experience, currently teaching Year 4 and/or Year 5 


courses. 


-- CAAT Faculty--all teaching faculty with one or more 
years of teaching experience, at Ontario Colleges of 
Applied Arts and Technology, currently teaching Year 


] and Year 2 post-secondary full-time programs. 


-- University Faculty--all teaching faculty with one or 
more years of teaching experience, currently teaching 
undergraduate courses to full-time students at Ontario 


universities. 
Sample Design 


The sample design for each of the educator groups can be 


termed a replicated, stratified, weighted random sample. 


Use of a replicated probability design permits an objective 
evaluation of the limitations on the conclusions that can 


be drawn from the survey data. That is, the design provides 


Digitized by the Internet Archive 
in 2023 with funding from 
University of Toronto 


https://archive.org/details/31/761116519315 


the capability of a calculation of a close estimate of both 
standard error due to sampling and, the combined sampling 
standard error applicable to each statistic reported. To 
achieve this end, four independent random samples were 


drawn for each of the three educator groups. 


The stratification tends to reduce the error inherent in 
sampling and does so to a point below the standard errors 
commonly obtained from ‘tables on tulerance limits for ran- 


dom samples. 


Weighting is necessary to compensate for residual non- 
response. However, while it reduces the bias it can also 


add to sampling error measurements. 
-c) Sampling Operations--University And CAAT Faculties 


According to established systematic probability sampling 
techniques, independent random samples of university and 
CAAT educators were selected. In both cases all insti- 
tutions were included in the sample frame, that is, twenty- 


two CAATs and sixteen universities.* 


For each institution included in the sample frame, lists of 
educators were developed and stratified in the following 


ways: 


* For the University of Toronto, St. George, Erindale and Scar- 
borough were listed as separate institutions. For Laurentian 
University, Sudbury, Algoma and Nipissing were listed as sep- 
arate institutions. Therefore, a total of 20 university 
institutions was involved. 
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Canadian Facts'! Sampling department obtained lists of 


educators fron the CAATs. 


The names of CAAT educators were stratified by pro- 
gram area within each institution. The four program 
areas were: Technology, Applied Arts, Health and 


Business. 


Within each program area, educators' names were listed 
randomly within each institution. The institutions 


were also listed randomly. 


Universities 


i) 


ii) 


Lists of educators' names were developed by Canadian 
Facts' sampling department using 1974/1975 university 


calendars. 


Names were stratified by program area within each 
institution. The program areas were: Humanties, 
Social Sciences, Sciences, Professional. The defi- 
nitions, outlined below, for each of these broad 
program areas was provided by the Ministry of Col- 


leges and Universities. 


Humanities/Arts--Asian Studies, Classics (Latin and 


Greek), Comparative Literature, Drama, English, Film, 
Fine Arts/Art, French, German, Italian, Linguistics, 
Medieval Studies, Music, Philosophy, Religion/Re- 


ligious Studies, Slavic Studies And Spanish. 


Social Sciences--Amerindian Eskimo Studies, Anthro- 
pology, Canadian Studies, Child Studies, Classical 
Archeology, Commonwealth Studies, Consumer Studies, 
Development Studies, Economics, Family Studies, 
Geography, History, International Studies, Latin 
American Studies, Native Studies, Political Sciences, 
Psychology, Soviet and East European Studies, Social 
Theory Program, Sociology and Studies in Social 


Action. 


Sciences~-Anatomy, Astronomy, Biochemistry, Biology, 
Biophysics, Botany, Chemistry, Computer Science, 
Earth Sciences, Geology, Liberal Sciences, Life 
Sciences, Marine Biology, Mathematics, Microbiology, 
Physical Geography, Physics, Physiology, Plant 
Science, Probabilities and Statistics, Science, 


General, Zoology and Statistics. 


Professional (i.e., Applied Arts, Applied Social 
Sciences, Applied Sciences)-~Agriculture, Animal 
Science, Applied Computational and Math Science, 
Applied Statistics and Computation, Architecture, 
Dental Hygiene, Dentistry, Engineering, Engineering 
and Management, Fisheries and Wildlife Biology, 
Forestry, Industrial Design, Medical Lab Sciences, 
Medicine, Metallurgy, Nursing, Optometry, Pharmacy 
Physical Education and Kinesiology, Regional Envi- 
ronment Planning, Rehabilitative Medicine, Survey 
Science, Urban Studies, Veterinary Medicine, Ad- 
ministration, Applied Human Nutrition, Business Ad- 
ministration, Commerce, Communication Arts, Education, 
French Language Translation and Studies, Health, Home 
Economics, Hotel and Food Administration, Journalism, 
Law, Library Technology, Public Administration, Recre- 
ational Studies, Social Work, Sports Administration, 


Textiles and Theology. 


hor gine! —Alerat® 
| aie POY PRA) MMi Meey, vent 

yf elem in Bie: lsat oT. Lae vend 
” pare 


’ <q tee? afMSTUR weenage* 

,moninl Gedy  qirgieenn .winee ,2ctgeaaci 
| 46) inti Noled.. ofp haalanal 
(pao Tdowatf i deel online ) hmeese 


ae ae Spode Jeays 


‘ iat a8 orien” ei Af Ja we ie pda 
ea Eau te oT ‘Wel ~ S_oterty! f 


» Ai =on Shee) Oe wip are 04: eee suite 


hips sal aoeh o a ial su joes dan @eetisae’ BONES 
Te | fe otis! neh me fv 16 10) wel" bg ning 
pdupealisnd) Fibs aes ce a 
(nw Penal — ane (jimh wiTenrind qo sign 
yank a aegis pide, cena im voit ae 


S47 Linch slay | cod Gara gee ania nha 
aad dia 36 pb @h@rt we bel paremtay * 


>| Fee ik oe - oa, atcogt rami jroo lee 

seb a ry GD aah slater <6 Dro | eR reers wie 

a ila anh is of img: aA aeNeiie© lana s pt eva 

. = i s a? ais 9 gen ae Gear 

“4 alte! 74 pik eae pa aa erp aoe | evinmacs? 

: hand Pays se dpdar (gag “44 el ead segs sea 

Vinobae reels iA, 2d eaape ol ad’ Chg Se ) Pere ise 

| | i 
Da 7 


rWUayhl 4g6308 yslngtnt = 


7% ; I ' 
; >a ys mH pt\iRp.stee tr Aha 
: 7 i 
| jue yomiady -Thane 
a, ae 


—— 


iii) Within each program area, educators' names were 
listed randomly within each institution. The in- 


stitutions were also listed randomly. 


The actual selection of educators! names took place after 
completion of the aforementioned procedures. The selection 
interval within each program area within each institution 


was determined by dividing the number of educators in each 


cell by the number of completions required in that cell, plus 
overage based on an estimate of the non-response level. A 
random number between '1' and the interval number 'X! was 


picked in each case to establish the ‘start point! for 
selection. Thus, all educators were given an equal chance 
of selection. Furthermore, the institutions and program 
groupings within institutions were represented in their 


correct relative proportions. 


Regarding the CAAT sample, a total of 4018 educators was 
listed, and 480 names were selected. Regarding the uni- 
versity sample, a total of 8707 educators was listed, and 


604 names were selected. 


The selected names for each of the university and CAAT 
samples were randomly assigned to one of four sample re- 
plicates. Each replicate, therefore, was, in fact, a 
random sample representative of the total population under 


study. 


It was clearly specified that Canadian Facts would not per- 
mit substitution of names once the final sample of univer- 
sity and CAAT educators was selected. However, provision 
was made for replacements in the university sample. A 


small proportion of faculty originally selected could not 
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be located because they were either on sabbatical or no 
longer teaching at the designated university. This problem 
occurred due to the fact that the sample frame source was 
1974/1975 calendars rather than up-to-date lists provided 
by the institutions. 


In total, 89 replacements were required. In all cases, 
the replacement was the name which appeared on the master 


list below the originally selected name. 
Sampling Operations--Secondary School Teachers 
ee etary ocnoot leachers 


The secondary school teachers! sample was selected in two 
Separate stages. First, the selection of institutions, 
and second, the selection of individual teachers within 


each designated institution. 
i) Selection Of Institutions 


In order to accommodate the needs of all ''Interface!! 
projects, two independent samples of secondary 
schools were selected, one sample for projects I! and 
ll! and one for project |. Only in the case of the 
French language schools were the samples not exclusive. 
Duplication of French language schools was necessary 
because of the relatively large number to be selected. 
lt was agreed that 60 English language and 15 French 
language schools be selected for each of the two sam- 
ples of institutions. The disproportionately large 
sample of French schools was required to permit inde- 
pendent examinations of responses from teachers and 


students at French language schools. 
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All public secondary schools in Ontario with SSGD 
and/or SSHGD students were included in the sample 
frame with the exception of those schools designated 
by the Ministry of Education as experimental or ex- 
ceptional. A total of 502 secondary schools was in- 


cluded in the sample frame. 


The first stage in the sampling operation involved 
grouping of the English and French language schools. 
(Bilingual schools were classified as French language 
schools.) Forty schools were classified as French 


Language, and 462 were classified as English. 


The English schools were stratified by size, i.e., 
number of potential Grade 12 and/or Grade 13 gradu- 
ates within region. Within each of the sub-strata, 
defined on the basis of size, schools were rank 
ordered by ratjo, of the number of SSHGD to the 
number of SSGD potential graduates. In the case of 
French language schools only the latter stratification 


rule was applied. 


The following table details the regional strata, the 
number of schools listed in each sub-stratum and the 


size of the schools included in each case. 
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Number Of ... 


Potential 
Schools Graduates 
(S02) tee 
# 
Regional Or Language Grouping: 
French ho 19 to 377 
Hami 1 ton 14 160 to 818 
Toronto 33 135 to 400 
21 +76 410 to 492 
22 501 to 860 
Northern ga 7 to 235 
24 246 to 459 
Western Urban et? 146 to 327 
16 | 336 to 619 
Eastern Urban 23 165 to 335 
18-59 = 341 to 405 
18 416 to 682 
Western Non-Urban 4 21 to 204 
i Zs tO 260 
26 289 to 548 
Eastern Non-Urban 4s 26 to 207 
34 F101 211 to 321 
22 326 to 535 


The regional strata were defined on the basis of popu- 
lation size and Ministry of Education region specifi- 


cations. The definitions are: 


i) Hamilton; 
ii) Metro Toronto excluding Mississauga; 
iii) Northern defined as Ministry of Education 
regions--northwestern, midnorthern, and north- 


eastern; 


=F) ;i abo a ie ti} 


iv) Western Urban defined as Ministry of Education 
regions--Niagara, western and midwestern 
centres of 50,000 population or greater; 

v) Eastern Urban defined as Ministry of Education 
regions--Ottawa Valley, central Ontario (ex- 
cluding Toronto but including Mississauga) and 
eastern Ontario centres of 50,000 population or 
Greater. 

vi) Western Non-Urban defined as Ministry of Edu- 
cation regions--Niagara, western and mid- 
western centres of less than 50,000 population; 

vii) Eastern Non-Urban defined as Ministry of Edu- 
cation regions--Ottawa Valley, central Ontario, 
and eastern Ontario centres of less than 50,000 


population. 


At the actual selection stage, each school was given 
a chance of selection proportionate to its size (the 
number of potential SSGD and/or SSHGD graduates). Two 
independent random samples, each comprised of 60 Eng- 


lish and 15 French language schools, were picked. 


An example of the selection procedure employed is 


provided below: 


Metro Toronto Sub-Section Number Of Number Of 


(Size Of School) Students Schools 
1. 135 to 400 10,200 55 
2. 410 to 492 9,558 21 
3. 501 to 860 13,148 D2 


Total 32,906 76 
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For each sample, the total number of English schools 
to be selected was 60. The total number of potential 
graduates in schools included in the sample frame was 
131,625. Therefore, the number of schools to be 


picked (per sample) in Metro Toronto was: 


60 x 32,906 _ : 
apoio: = 15 schoo 


Within each Metro sub-stratum, the number of schools 


to be picked was: 


1 ie ya 'y' = number of students in each sub- 
32,906 stratum. 


Thus: 
Number Of Number Of Number Of Schools 
Students Schools __ To Be Picked 
1. 10,200 33 » ars 
De ee bak 21 4 
ae Syd ae ae mG 
Total = 32,906 76 15 


Subsequently, a cumulative tape for each sub-stratum 
was prepared. The selection interval was determined 
by dividing the total number of students in any given 
sub-stratum, by the number of schools to be picked in 
that sub-stratum multiplied by the number of samples 
to be drawn at one time, that is, one sample for 
project I, one for projects Il and lit and a substi- 


tute sample.* Therefore, referring to sub-stratum 


* No substitute schools were used for Project |. 
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Soe Selection interval. 


A random number between '1' and the selection interval 
determined the selection start point. After selection 
of the schools in each sub-stratum, schools were rand- 


omly assigned to one of the three samples. 
Selection Of Individual Teachers 


The second sampling stage involved the selection of 
the secondary school teachers. Each Grade 12 and/or 
Grade 13 secondary school teacher was to be given an 
equal chance of selection. In that the institutions 
received a probability of selection proportionate to 
size, in order to select a random sample of teachers 
with equal probability of selection equal numbers of 
interviews were conducted in each school. An example 


of how the probability are balanced is provided below: 


Probability Of 


Probability Of Selection Of Resultant 
Selection Of Teachers Within Probability 
School Size Each School* _ Each Institution of Selection 
A 600 600/1200 10/600 1/120 
B 400 400/1200 10/400 1/120 
C 200 200/1200 10/200 1/120 
Total -= 1200 


* Since the institutions were selected proportionate to 
the size of their student rather than teacher population, 
a calculation of the teacher to student ratio was neces- 
sary to ensure that subsequent data adjustment was not 
necessary. 
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Secondary school principals were asked to submit lists 
of Grade 12 and/or Grade 13 teachers by discipline(s) 
taught. Within each institution teachers were strati- 
fied by discipline, namely, first language, mathemat- 


ics, and others. 


Teachers at French language schools were selected from 
within each discipline group proportionate to the size 
of each discipline group. Disproportionate sampling 
was employed in the case of teachers at English lan- 
guage schools. The number of teachers selected for 
participation in each school was disproportionately 
assigned by discipline to yield 100 teachers of math- 
ematics, ICO first language teachers and 100 teachers 


of other subjects. 


Of the 60 English and 15 French language schools se- 
lected, 5 English and |] French school chose not to 
participate. Therefore, lists of teachers were pro- 
vided by 55 English and 14 French language schools. 
Teachers names were stratified by discipline within 
each institution. A total of 684 teachers names 

was picked. From within each of 26 English language 
schools, 12 teachers names were selected; from 
within 29 English language schools, & teachers names 
were selected.* Ten teachers names were selected 
from each of the 14 French language schools. The se- 
lection interval in all cases was determined by divid- 
ing the number of names to be selected in each sub- 


cell by the roel number of names in that sub-cell. A 


* Adjustment for unequal size of selection took place 
at the weighting stage. 
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random number between | and the interval was picked 
to determine the selection start point. Names were 
randomly assigned (within each sub-cell) to one of 


four sample replicates. 


Completion Rates 


The following table details the number of questionnaires 
distributed and the actual number of completions at each 


of the primary levels of investigation. 


Number Of Questionnaires: 


Completed 
Sent Question- Completion 
Out naires _ Rate 
# ## # 
Secondary School Teachers: 

TOTAL 684 567 83 
First Language (English/ 
frangais) 150 130 87 
Mathematics 153 13] 86 
Other 381 306 80 

English Language Schools 

(Total) 54h L65 85 

French Language Schools 

(Total) 140 102 73 

CAAT Faculty: 

TOTAL 480 403 84 
Applied Arts 147 119 8] 
Business 86 74 86 
Health 114 97 85 
Technology 138 113 85 

University Faculty: 

TOTAL 604 #39 73 
Humanities/Arts 14h 109 76 
Social Sciences 160 102 64 
Sciences 156 123 79 


Professional 14h 105 73 
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Because of the relatively high completion rates obtained, 
potential bias due to non-response was minimized. Com- 
parisons of actual returns to universe data indicated that 
non-response was not confined to any particular population 
segment. Indeed, the small weighting factors* necessary 
to adjust the sample indicate the representativeness and 


projectability of the final educators' samples. 


Weighting Procedure 


A minor adjustment to each of the three educator samples 
was made to bring the various program/discipline groups 
within institutions into their correct relative proportion, 
according to the universe statistics compiled at the sample 
selection stage. (The source of these statistics was lists 
of university educators taken from the 1974/1975 calendars, 
and lists of CAAT and secondary school educators provided 


by the CAATs and secondary schools respectively.) 


The following tables detail the actual number of comple- 
tions obtained and the weighting factor (cited to two dec-~ 


imal places) employed in each sub-cell. 


* The relatively large weighting factors applied to the 
secondary school teachers sample were necessary due to 
the disproportionate sampling technique employed. 
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UNIVERSITIES 


Institutions ... 


ee 
i eee 


PROGRAM AREA: 


Humanities 


--weighting 
factor OS 7050 
--actual ‘| iF 
Social 
Sciences 
--weighting 
factor 0.80 0.80 
--actual 5 5 
Sciences 
--weighting 
factor 0.67 1.00 
--actual 6 1 


Professional 


--weighting 
factor 0.88 - 
--actual 8 = 


Laurentian 


Sud- 


0.73 0.60 
1] 3 
0.90 1.00 
10 2 
0.8] 1.00 
16 3 
1.20 0.50 
5 2 


Nip- 


Al- is- 


0.60 0.60 0.67 
l l 2 
DUELS) SPE O LOS 8 here 
l | 4 

- = 1.00 
- z 3 
= 0.50 0.50 
ce z 2 


... (Continued) 
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UNIVERSITIES 


Institutions 


UOT Ty 
York 
Glen- 
Car- don 
le- Wilfred Col= St. Erin- Scar- 


ton Queens Laurier Guelph York lege George dale borough Ottawa 


a 


PROGRAM 
AREA: 
Humanities 


--weight- 


ing 
factor 1.00 0.67 “0.67 35 Sal Viele 70-92 200° 1.00 1.00 


--actual 6 9 3 3 8 1 25 Z 1 8 


Social 
Sciences 
--weight- 
ing 
factor 0.90 0.78 1.00 0.86 1.00 1.00 1.55 1.50 1.50 6.00 
--actual 10 9 2 7 10 3 1] 2 2 1 


Sciences 


--weight- 
ing 
faceor 1.25, 0.70. ai.00 loh2) [OS ka Te 0.78 0.50 2.00 1525 


--actual 4 17 2 8 Gin a 27 4 l 4 


Professional 

--weight- 

ing 

factor, 1.25 0.72 - 0.86 1.67 1.67 0.89 = = Leek? 
--actual 4 18 = 14 2 1 19 = - 6 


Total--Actual 


PROGRAM AREA: 


Technology 


--weighting 
factor 


--actual 


Applied Arts 


--weighting 
factor 


--actual 


Health 


--weighting 
factor 


~-actual 


Business 


--weighting 
factor 


~-actual 


ni ig 


CAATS 


Institutions ... 


Al- 
gon- 
qu- 


in 


38 


eel 


1.45 
1 


eas 
6 


1229 
7 


Cam- 


15 


1.00 
2 


Cen- 


Cana- ten- ni- 


em ee 


, 17 
0.50 1.00 
2 5 
1.00 1.00 
] 5 
1.00 0.75 
2 k 
0-75: 1.00 
h 6} 


Co- Con- 


0.75 1.00 
4 3 


0.67 1.00 


0.67 0.66 


ham 


1.00 


0.50 


feder- Dur- Fan- 


0.85 
13 


1.10 


-.. (Continued) 


George 


1.30 
10 


14 


0.80 
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CAATS 


Institutions ... 
SUE 
Sand- 
Ni- Sts Sault ford 
Hum- Lamb- Loyal- Mo- aga- North- St. Law- Col- Sen- Sher- Flem- 
ber ton ist hawk ra ern Clair rence lege eca_ idan_ ing 


Total-- 
Actual 25 7 10 29 17 8 17 30 1] Zz] 22 14 


PROGRAM 
AREA: 
Technology 


--weight- 
ing 
factor 0.80 1.00 3.200 1.9370-75 1200 i.25 0.88. 1200,6.83 14.004 0.66 


--actual 5 2 3 8 k 6 4 8 5 6 le 42 7 


Applied Arts 
--weight- 
ing 
- factor 1.10 1.00 80.67 3.00: inyy “1200 1.33 0.88 1.00 1.00 0.93 1.50 
--actual 10 2 3 6 6 | 3 8 3 #1 14 2 


Health 


--weight- 
ing 
factor 0.83 0.50 1.00 0.90 1.00 = 0.66 0.68. 1:00°1.00°).0.67° 1.00 


--actual 6 2 2 1] kh - 4 7 8 2 4 3 2 


Business 


--weight- 
ing 
fector 1.00 1.00 1.00 1.00 1.33 2:00 1.33 0.83 1.00 1.00% 41.00 4.00 


--actual h 1 2 4 3 ] 3 6 ] 6 3 3 


Total 


PROGRAM 
AREA: 
Math 


--we ight~- 
ing 
factor 


--actual 


First Lan- 
guage 
(English) 


--weight- 
ing 
factor 


--actual 


All Other 


--weight- 


ing 
factor 


--actual 


eric 


SECONDARY SCHOOLS--ENGLISH 


Institutions ... 


Eto- 
bi- Nel- Hill- 
coke son crest 
Col- This- En- New A. (Thun- 
legi- tle’ West- River- Rich- gle- Lisk- Lock- Glen- Boy- der) 
ate Town hill dale view hart eard erly dale len Bay) 
8 8 12 1] 8 8 7 8 6 5 12 
1.50 1.00 0.67 1.00 1.50 1.50 1.00 1.00 0.50 2.00 0.67 
2 Z 3 3 2 2 | 2 2 ] 3 
1.00 0.67 0.67 1.00 1.00 1.00 1.50 1.00 1.00 3.00 1.33 
2 3 3 2 Da pee 2 2 2 i 3 
3.00 4.33 2.17 2.00 3.00 3.00 3725. 3.25 7-00 4,00 1.83 
4 3 6 6 4 L 4 4 2 3 6 
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SECONDARY SCHOOLS--ENGLISH 


Institutions ... 


North 
Sir David Tor- 
' Wil- And onto Galt Dr. 
fred Mary. Col- Mon- Queen Col- F.J. Grant- 
Laur- Thomp- W.D. legi- arch Eliz- legi- Done- ham Walker- Wood- East: 
ier son Lowe ate Park abeth ate van High ville lands dale 
Total 7 7 8 6 1] 8 8 12 4% 5 oui ah 
PRO- 
GRAM 
AREA 
Math 
--weight- 
ing 
fac- 
tor ) 150 W.00 “1.50 1200 0.75) 1200) 12507 0267> 5 = 1.00 0.67 
DaeaGtu= 
al 2 1 2 fa 4 2 2 ls - 2 3 
First 
Language 
(Eng- 
lish) 
--weight- 
ing 
fac~ ; 
tor 3.00 1.50 1.00 1.50 0.50 1.00 2.00 1.00 1.50 3.00 1.00 1.00 
==ectu- 
al | 2 2 2 4 2 I 3 Z 1 2 3 
All Other 
--weight~- 
ing 
fac~ Sok: 
tor 2.75 3.25 3.00 6.00 4.00 3.25 2.40 2.00 6.00 3.00 3,25 2.40 
--actu- 
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SECONDARY SCHOOLS--ENGLISH 


Institutions ... 


Earl 
Lis- Brant- North Fel- Of 
lowes March ham 


ee ee 


Total 8 7 12 11 6 1] 


PRO- 
GRAM 
AREA: 


Math 


~-weight~- 
ing 
fac- 
tor 1.50 0.67 


Paget 


al 2 3 3 3 2 3 


0.67 ©1200) 51.00) 90233 


First 
Language 
(Eng- 
lish) 


--weight- 
ing 
fac- 
for i. 5O 2.00 


0.67 1.00 3.00 1.00 


=--actu- 
al 2 1 3 3 1 3 


All Other 


--weight- 
ing 
fac- 


tor 2.75 4.33 


=-actu- 


al h 3 6 5 3 5 


2.17 .2.20° 4200 2560 


Lord 


Mark- Bant- Chat- Dor- 


7 8 1 
2.00 0.67 0.50 
1 3 2 
1.00 1.00 1.00 
Z 2 3 
3.25. 452 2aly 
4 3 6 
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SECONDARY SCHOOLS--ENGLISH 


Institutions ... 


Sir 
Ro- Centre 
bert West- Leam- Wel- = An- 
Bor- Wel- mins~- Inger- ing- Grims- Bram= Brook- Dunn- ling- der- 
den land ter_ soll ton by Athens alea field ville ton son 
Total 1] 9 i 1] 6 8 2) i 7 8 6 6 
PRO- 
GRAM 
AREA 
Math 
--weight- 
ing 
fac- 
tor 0.67 - 1.50 0.67 2,00 O67 1.5079 700190267 “S7200 2260 3.00 
== Actus 
al 3 - 2 3 | 3 2 2 3 2 | 2 
First 
Language 
(fran- 
gais) 
--weight- 
ing 
fac- 


tor 1.00 1.00 1.00 0.33 2.00 2:00 9 P2060, 1200 3.00 1.00 2.00 1.50 


=-actu- 
al 3 3 2 3 1 | 73 Z 1 2 l 2 


All Other 
--weight- 
ing 
fac- 
tor 2.40 2.00 4.002280 32525: 3.25 927800 B33, 0.) 325: 93.25" 6.00 


=-actu- 


al 5 6 3 5 4 4 E) 3 : 4 4 2 
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PROGRAM AREA: 


Math 


--weighting 
factor 


--actual 


First Language 


(francais) 


--weighting 
factor 


--actual 


All Other 


--weighting 
factor 


--actual 


a ere 


SECONDARY SCHOOLS--ENGLISH 


Institutions ... 


Cobourg Henry 


East 
12 10 
0.67 1.00 
3 3 


0.67 1.00 
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6 5 
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3.00 


12 


1.33 


1.83 
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SECONDARY SCHOOLS--FRENCH 


Institutions ... 
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Eon B.S: 
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Garn- Bel- De La Charle- quois feder- 
eau court salle bois Falls ation Theriault 
Total ie) 2 : ae 3 6 6 ) 
Math 
--weighting factor 0.43 - 0.43 - 0.43 0.43 0.43 
--actual l = ] be 1 | 2 
First Language 
--weighting factor 0.34 0.34 0.34 ~ - 0.34 0.34 
--actual far 1 2 = = | | 
All Other 
--weighting factor 0.45 0.45 0.45 0.45 0.45 0.45 0.45 
--actual 7 1 l 3 5 h 6 
Institutions ... —_ 
BS EsS. 
Scie Eon Ee Sy edos be’. Pie Se La 
MacDonald- Plantag- Glen- Ham- gon- Franco- Cita- 
Cartier enet garry mer quin Jeunesse delle 
Total 6 10 10 10 7 10 10 
Math 
--weighting factor 0.43 0.43 0.43 0.43 0.43 0.43 0.43 
--actual ! 2 1 l ] 1 ! 
First Language 
--weighting factor | 0.34 0.34 0.34 - 0.34 0.34 0.34 
--actual ] ] l = } 1 ] 
All Other 
--weighting factor 0.45 0.45 0.45 0.45 0.45 0.45 0.45 


--actual 4 ] 8 9 5 8 8 


Sos: i) lS re _ 


. - 
. vin 
] 
a > = 4 ow b 
os -_ =" 
; a on 
S 
— v re 
v 
Bis 
7 =) a Ph 


ol Ootieera oh 


+ oR oMiieeneds seeing tie 


a) cpritterie, 


925 /u 


The following table delineates the actual and weighted 


number of completions for each of the educators! samples. 


Completed Questionnaires: 


(Actual) (Weighted) 
# # 
Secondary School Teachers: 

TOTAL 567 973 
English Language (Total) 65 929 
French Language (Total) 102 Lh 

CAAT Faculty: 

TOTAL 403 LOO 
Applied Arts 119 122 
Business 74 73 
Health 97 94 
Technology 113 i 

University Faculty: . 

TOTAL 439 399 
Humanities/Arts 109 93 
Social Sciences 102 105 
Sciences 123 106 
Professional 105 95 


As previously indicated, secondary school principals were 

asked to provide lists of their teaching staff (Grade 12 and/ 
or Grade 13 teachers only) along with identification of the 
subject(s) taught. Also, each respondent was asked to indicate 
on the questionnaire the subject or subjects taught. In the 
latter case, the main subject taught could not always be ident~ 
ified. Therefore, ‘discipline taught' information could be 
derived from two sources, and each source was used for a diff- 
erent purpose. For weighting purposes, we referred to the 
discipline identification provided for each teacher by the 
school principals. For tabulation purposes, we referred to 

the discipline information provided by respondents, thus taking 


into account multiple responses. 
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56. 


The General Public (Including Students) 
Universe 


The universe sampled for this study included all individ- 
uals 18 years of age and older eligible to vote in Ontario 
elections, and a special sample of students. Students were 
defined as those who attended Grade 12 or 13 at an Ontario 
public school, secondary level and those who were enrolled 
in undergraduate programs at Ontario colleges of applied 
arts and technology or at universities, during the 1975/ 


1976 school year. 


Sample Design 


The sample selected can be termed a stratified multi-stage 


clustered, weighted replicated design. 


The stratification tends to reduce the error inherent in 
sampling, and does so to a point below the standard errors 


commonly obtained from tables on random samples. 


Clustering at various stages of selection while offering 
some cost efficiencies, can add somewhat to the standard 


error. 


Weighting is necessary to compensate for residual non-re- 
sponse. However, while it removes bias it can also add to 


sampling error measurements. 


The replicated aspect of the design permits a calculation 
of a close estimate of the true standard error applicable 
to each statistic in the report, taking into account al] 

of the above influences. For both the general public and 


student samples four independent random samples were drawn. 


Sy ae 


In constructing a probability sample of anes universe the 


following conditions were met: 


~~ each of the persons in the universe had to have 
some chance, which could be stated mathematically 


of being included in the sample; 


-- no arbitrary judgement was exercised in determining 
which households or individuals within households 


were included. 


-c) Sampling Operations 


The sample operations were carried out at four different 


and distinct levels: 


-- the selection of localities (metropolitan districts, 
individual cities over 10,000 and rural by township) 


Stratified by geographic district and income; 


-- the selection of an enumeration area within each 


locality to be visited by interviewers; 
-- the selection of particular households; 


-- the selection of individuals at random by means of 


a listing procedure. 


The probability with which each individual was finally 
selected, therefore, ultimately depended upon the separate 


probabilities at each of the stages of sampling. ! 


The sample design did not allow for either the substitution 
of households or the substitution of individuals within 
households. 
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(i) Selecting The Localities 


Canadian Facts produced a special tabulation from 
the 1971 Census of Canada. The tabulation was con- 
structed in such a manner that the enumeration 
areas of Ontario were sorted into region, community 
size and income. On the basis of this tabulation, 
a set of replicated systematic random clusters were 


selected. 
(ji) Selecting Clusters 


In enumeration areas where block statistics existed, 
block counts were used to increase the precision of 
selecting households. (Approximately 50% of the 

selected sample was located using the block level of 


detai!.) 


In enumeration areas where block statistics did not 
exist, the usual methods of locating households on 
blocks were employed. (In rural areas, artificial 
blocks were constructed from National Topographical 
Series Maps and Enumeration Area Maps.) All blocks 


had an equal probability of falling within the sample. 


In total 192 clusters were selected for the general 
public sample and 192 matched clusters were selected 


for the student sample. 
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(iii) Selecting Households Within Clusters 
(Where Block Statistics Were Not Available) 


For each selected cluster, interviewers were 
provided with a detailed map showing the location, 
the road segments contained within the cluster, 
and outlining clearly its boundaries. Each open 
country cluster was bounded by distinct landmarks 
which could be identified by the interviewer, 
while for cities, towns and villages, interviewers 
were given map enlargements showing the names of 
the streets included within the clusters. For each 
cluster, a starting point was selected at random. 
interviewers were instructed to begin at the start 
point and to work in a randomly determined direc- 
tion indicated by red arrows, calling at a pre- 
determined start house and each household on the 
way until the assigned number of households had 
been visited.* At this point, addresses were 
listed on individual questionnaires which would 
designate the sample frame of households which 
were to be called upon until an interview was 
completed or the required number of callbacks had 


been made. 


(iv) Selecting Individuals Within Households 


General Public 


The interviewer first determined how many people, 
aged 18 years and over and eligible to vote, lived 


in the particular household. She then listed them 


in the case of the general public sample, interviewers 
visited 1] households on each of the 144 urban clusters 
and 7 households on each of the 48 rural clusters. In 

the case of the student sample, interviewers visited 30 
households on each of the 144 urban clusters and 20 house 
holds on each of the 48 rural clusters. 
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in a specified order on a special section of the 
questionnaire. A random set of markings then auto- 
matically determined which one particular individual 


should be interviewed in the household. 
Student Sub-Sample 


The interviewer determined if any individuals were 
enrolled, during the 1975/76 school year, in an 
ontaets public secondary school in Grades 12 or 13, 
in an undergraduate program at an Ontario univer- 
sity or a CAAT. All individuals who qualified as 


students were to be interviewed, if possible. 


Callback Procedure 


Regarding the general public sample, in order to minimize 
bias that might be caused by non-representation of those 
away from home at the time interviewers called, up to 
seven personal calls were made to complete an interview 
with the designated respondent in urban areas and up to 
two personal calls were made in rural areas. For the 
student sample, up to four personal calls in urban areas 


and up to two in rural areas were made. 


Completion Rates And Reason For Non-Response 


The following table details the number of contacts and 
completed interviews among members of the general public 


and student populations. 
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(i) Completion Rate--General Public 


Total Number Of 
Household Contacts Assigned 


Total Number Of 
Household Contacts Completed 


Total Completions 


Total Non-Completions 


Reasons For Non=Completion: 


No one at home/respondent 
not at home after callbacks 


Refused listing 
Refused to be interviewed 


at all 


(ii) Completion Rate--Students 


Total Number Of 
Household Contacts Assigned 


Total Number Of 
Household Contacts Completed 


Total Number Of Students-- 
Potential Completions 


Total Completions 


Total Non-Completions 


Reasons For Non-Completion: 


No one at home/respondent 
not at home after callbacks 


Refused listing 


Refused to be interviewed 


1920 


1913 
1004 


909 


294 


4h? 


455 
56 
147 


100% 


53 
48 


100% 
36 
64 


45 
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Weighting Procedure 


General Public Sample 


Two weighting schemes were applied to the general 
public sample: weighting for household size, and 


residual weighting. 


Weighting For Household Size 


The sample design for this study called for a 
probability sample of individuals. Because of the 
requirement that only one interview per household 
be conducted, the final unweighted sample is repre- 
sentative of households, not of individuals. This 
results from the fact that individuals from rela- 
tively large households are under-represented in 
the final sample. For example, in a household con- 
taining 5 eligible voters, each voter receives a 
20% chance of selection; in a household containing 
2 eligible voters, each voter received a 50% chance 
of selection. Under this scheme, each individual 
is not given an equal chance of selection, but 
rather those from small households are given a 
greater chance of inclusion. Adjustment, therefore, 
is necessary to compensate for these unequal prob- 
abilities. The weight applied to each informant's 
card is the reciprocal of the number of eligible 


voters contained in that informant's household. 
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Thus: 


No. Eligible Chance Of Weighting Resultant 
In Household Selection Factor Probability* 


5 1/5 5/1 x 1/10 1/10 
3 1/3 3/1 x 1/10 1/10 
ae 1/2 2/1 x 1/10 1/10 
Total . 10 


The final adjusted or weighted sample is, therefore, 
representative of all individuals in the sampled 


universe. 
Residual Weighting 


Statistics of provincial voters by age, sex and com- 
munity size are not available. The sample was ad- 
justed to bring age, sex and community size groupings 
into their correct relative proportion according to 
the latest known universe statistics (1971 Statistics 
Canada data) for individuals 18 years of age and over 
in the Province of Ontario. The effect of including 
the non-eligible voter segments of the population in 
the sample adjustment is felt to be minimal because 
of the relatively small size of this segment of the 
population (estimated at about 2% of all adults 


living in Ontario). 


The final weighting table for the general public 


sample is detailed on the following page. 


* This assumes that the completion rate for each sample location 
is identical. In actuality, completion rates differ somewhat 
from location to location. 
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Student Sample 


The student sample design allowed for more than 
one interview per household, and hence, no 
"household' adjustment was necessary. In ad- 
dition, no residual adjustment of age, sex or 
community size was applied because no precise 
Statistics for this population group were avail- 
able. Hence, the student sample tabular results 


are reported on the actual number of completions. 
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B. STATISTICAL TOLERANCES 


As previously indicated, the replicated aspect of the 
design permits a calculation of s close estimate of 

the true standard error applicable to each statistic! 
in the report. Variances are reported at the 90% and 


95% level of confidence on a number of key variables, 


The percentages shown below may differ slightly from those shown 
in the detailed tables. The use of replicated samples provide 

a revised estimate of the mean as well as a revised estimate of 
the sampling error. In most cases, the revised mean is not 
likely to differ from that reported in the tabular results. 
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Tolerance Limits () At: 
90% Level 95% Level 


Of Of 
Confidence Confidence 
4 4 % 
Educators: 
eA AS dod 
Secondary School Teachers: 
Overall Student Achievement Of 
University Bound Students: 
Improved a great deal 6.0 2.7 3.4 
Improved a little 20.0 1.8 Zaz 
Remained the same 16.7 Sal 6.3 
Deteriorated a little 38.1 1.5 1.9 
Deteriorated a lot 14.1 2.6 3.3 
Overall Student Achievement Of 
CAAT Bound Students: 
Improved a great deal 6.0 1.4 ey 
Improved a little 24,8 Sine 4.0 
Remained the same 26.0 240 3.4 
Deteriorated a little 29.1 43 5.4 
Deteriorated a lot Ves ta 2.1 
Overall Student Achievement Of 
Work Bound Students: 
Improved a great deal gal 0.47 O59 
Improved a little 2256 3.9 4g 
Remained the same 24.0 3.8 hey 
Deteriorated a little 35.0 3.5 44 
Deteriorated a lot 10.3 V5 1.9 
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Tolerance Limits (+) At: 
90% Level 95% Level 


Of Of 
Confidence Confidence 
i 4 4 
University Faculty: 
Overall Achievement Of 
Students At Undergraduate 
Schools: 
Improved a great. deal 3.3 1.4 1.8 
Improved a little 19.9 2.4 S50 
Remained the same 22.0 1.6 Ze0 
Deteriorated a little 9.3 3.8 4.8 
Deteriorated a lot 1053 2 3.0 
CAAT Faculty: 
Overall Achievement Of 
Students At CAATs: 
Improved a great deal ya | 4,8 6.0 
improved a little 37.1 0.9 1.) 
Remained the same 18.0 2.5 3.1 
Deteriorated a little 15.2 3.9 Lg 


Deteriorated a lot 1.0 0.8 1.0 
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Tolerance Limits (+) At: 


90% Level 95% Level 


Of Of 
Confidence Confidence 
Z beak i 
Proficiency In Basic Language 
Skills Has Deteriorated: 
Secondary school teachers 67.0 BT, Ley, 
University Faculty 69.0 225 3.5 
CAAT Faculty 69.7 3.5 44 
Proficiency In Basic Math 
Skills Has Deteriorated: 
Secondary school teachers 49.9 a) 5.6 
University Faculty 39.8 3.4 4.3 
CAAT Faculty Dias Le2 eae) 
Best Method For Determining 
Proficiency: 
Compulsory Core Subjects--SSGD: 
School Achievement Exam- 
inations And Evaluations 
By Teachers: 
Secondary school teachers 29.4 20 2.5 
University Faculty 18.3 3.1 3.9 
CAAT Faculty iene 3.4 4.3 
Provincial Achievement 
Examinations And Evalua- 
tion By Teachers: 
Secondary School teachers 12 5.8 Tee 
University Faculty 24,4 3.5 
CAAT Faculty 30.8 hay way 
Standardized Achievement 
Tests And Evaluation By 
Teachers: 
Secondary school teachers 20.3 lel ia 
University Faculty 20.1 3.9 hg 
CAAT Faculty PAR hal 1.4 
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Tolerance Limits (+) At: 


90% Level 95% Level 
Of Of 
Confidence. Confidence 
% v4 ie 
External Provincial 
Achievement Examinations: 
Secondary school teachers 6.9 2.9 3.6 
University Faculty 18.5 Zao 3.5 
CAAT Faculty 15.0 3.9 4.8 
Best Method For Determining 
Proficiency: 
Compulsory Core Subjects-- 
SSHGD: 
School Achievement Exam- 
inations And Evaluation 
By Teachers: 
Secondary schoo! teachers Uo 23 2.8 
University Faculty 6.6 h.5 iS 
CAAT Faculty 7.8 Fag Bn 
Provincial Achievement 
Examinations And Evalua- 
Secondary school teachers 33.2 6.2 Ed 
University Faculty | 34.2 cd 4.7 
CAAT Faculty 38.7 ae | 3.4 
Standardized Achievement 
Tests And Evaluation By 
Teachers: 
Secondary school teachers by Ae 0.8 1.0 
University Faculty 14.2 0 5.0 
CAAT Faculty 19.6 2.5 3.2 
External Provincial 
Achievement Examinations: 
Secondary school teachers lend al 6.4 
University Faculty 30.8 Sie 4.0 
CAAT Faculty ey 2.8 3.5 
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Tolerance Limits (+) At: 

90% Level 95% Level 

Of Of 

Confidence Confidence 
% % 


oe 


General Public And Students: 


Perceived Performance Of 


secondary School Graduates: 


Basic Reading And Writing 
Skills Have Deteriorated: 


General Public 53.8 1.9 2.4 
Students 59.0 3.5 44 
Basic Math Skills Have 
Deteriorated: 
General Public 34.9 2.9 3.6 
Students 28.6 Soy 4.7 


Quality Of Education Re- 
ceived By Students At 


High School: 
General Public: 


Improved a great deal over 
the last 10 years Deb LF Ze 


improved a little over the 
last 10 years 235 eG | Ball 


Remained the same 15.4 2Ao 3.5 


Deteriorated a little over 
the last 10 years CRAAS 1.1 ee} 


Deteriorated a lot over 
the last 10 years 13.9 1.1 ligas 
Students: 


Improved a great deal over 
the last 10 years 102 on5 3.1 


Improved a little over the 
last 10 years 35.6 6.3 


Remained the same az 


Deteriorated a little over 
the last 10 years 30.1 3.4 43 


Deteriorated a lot over 
the last 10 years 10.1 1.2 1.4 
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Tolerance Limits (+) At: 
90% Level 95% Level 


Of Of 
Confidence. Confidence 
LEA oa 

4 4 


oe 


Quality Of Education Re- 
ceived By Students At CAATS: 
General Public: 


Improved a great deal over 
the last 5 years I=9 ibe) Des 


Improved a little over the 
last 5 years ~ 39.0 Sul 350 


Remained the same 22.1 1.4 fate! 


Students: 


Improved a great deal over 
the last 5 years 20.4 45 5.6 


Improved a little over the 
last 5 years 45.6 aul Zac 


Remained the same 18.7 2 5.3 
Quality Of Education Re- 
ceived By Students At Uni- 
versities: 
General Public: 


Improved a great deal over 
the last 10 years 1350 3.5 4k 


Improved a little over the 
last 10 years 28.0 Ze 2.6 


Remained the same BS) 3.1 3.9 


Students: 


Improved a great deal over 
the last 10 years 13.8 eee 2.9 


Improved a little over the 
last 10 years 36.0 5.3 6.6 


Remained the same 22.6 3.0 3.8 


Attitude Toward Compulsory 


Core: 


Certain Subjects Should Be 

Compulsory: 
General Public ara 4.0 4g 
Students B17 3.6 4s 
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C. QUESTIONNAIRE DEVELOPMENT 


We Introduction 


The questionnaires for the educator and general public 
studies were developed in two stages ... qualitative re- 


search and pre-testing of questionnaires. 


The results of the qualitative investigation are reported 


in the following section. 


Sy his 


Qualitative Research 


Methodology 


In order to understand the vocabulary of various popu- 
lation groups, and to gain an initial understanding of 
the types of attitudes extant within these groups a pro- 
gramme of qualitative research was initiated as a prelim- 
inary exercise. The qualitative approach was not designed 
to be an exhaustive in-depth study of attitudes toward 
education among all the population groups of interest to 
the Ministries. Rather, it was designed to provide 
concrete guidelines for the construction of questionnaires 
that have as their specific focus the interface between 


the secondary and post-secondary institutions in Ontario. 


An exploratory qualitative phase was deemed important 
because of the unique contributions this type of research 
can make to the final quantitative phase. In an area as 
broad as ''education'', and in an attempt to direct mean- 
ingful questions to people with very divergent levels of 
experience and expertise within the field of education, a 
qualitative investigation is especially helpful because it 
can eliminate many superfluous issues, and help crystalize 


the areas of particular interest to each of the sub-groups. 


The qualitative techniques employed were the individual 
in-depth interview and the focus group discussion. 


(see 2 -e) The Technique). 


The following table summarizes the research programme 


undertaken: 
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-ij) Group Discussions 


University Faculty 


1 University of Toronto, St.George Campus, Toronto, Ontario. 
Representatives of various disciplines 


all currently teaching first year students. 


Des Lakehead University, Thunder Bay, Ontario. 
Representatives of various disciplines 


all currently teaching first year students. 


CAAT Faculty 

a George Brown College of Applied Arts and Technology and 
Seneca College of Applied Arts & Technology, Toronto,Ontario. 
Representatives of various disciplines 


all currently teaching post-secondary courses. 


, Confederation College, Thunder Bay, Ontario. 
Representatives of various disciplines 


all currently teaching post-secondary courses. 


First Year University Students 


Be University of Toronto, St.George Campus, Toronto, Ontario. 


Representatives of various disciplines. 


First Year CAAT Students. 


Gy Confederation College, Thunder Bay, Ontario. 


Representatives of various disciplines. 


General Public 


ie Parents with secondary school education who have 
children in grades 12 or 13. 
Total Family income $15,000 - $30,000. 
1/2 Male; 1/2 Female. 


Toronto, Ontario. 
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-ii) Individual jnterviews 


Post-Secondary Educators 


ts University Administrator, University of Toronto. 
Le CAAT Administrator, George Brown College of Applied Arts 
and Technology. 


Employers 

Ste Personnel Officer, Package Goods Firm, Toronto. 

he Personnel Officer, Financial Institution, Toronto. 

Bi. Personnel Officer, Manufacturer of Computer Equipment, Toronto. 
6. Personnel Officer, Oi] Company, Toronto. 

ds Personnel Officer, Paper Processing Plant, Thunder Bay. 

8. Personnel Officer, Financial Institution, Thunder Bay. 

oe Personnel Officer, Construction Firm, Thunder Bay. 


Secondary School Teachers 


10. History - Grades Il, 12 and 13, Mississauga, Ont. 


ai Mathematics - Grade 13, Mississauga, Ont. 


12, English - Grades 12, 13, Mississauga, Ont. 
13% French - Grade 12, Mississauga, Ont. 

14. Physics - Grades 12, 13, Mississauga, Ont. 
152 Guidance Counsellor - Mississauga, Ont. 
16. Science - Grade 13, Thunder Bay, Ont. 

i? History - Grades 12, 13, Thunder Bay, Ont. 


18. English - Grade 12, Thunder Bay, Ont. 
19. Mathematics - Grades 12, 13, Thunder Bay, Ont. 
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Secondary School Students 
Grade 12 = Work Bound Student 


20. I- Mississauga, Ontario 


Alb 2- Thunder Bay, Ontario 


Grade 13 = Work Bound Student 


Didi - = Mississauga, Ontario 


Grade 12 - College Bound Student 


23}. 2- Thunder Bay, Ontario 


Grade 12 - University Bound Student 


24. l= Mississauga, Ontario 


Grade 13 - College Bound Student 


Da l- Thunder Bay, Ontario 


26. 2- Mississauga, Ontario 


Grade 13 - University Bound Student 


Wife l=- Thunder Bay, Ontario 


OAS os 2=- Toronto, Ontario. 
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General Public 


Parents with University Bound Children * 


29. Male = Toronto, Ontario 
30. Female - Toronto, Ontario 
Bllcs Female - Thunder Bay, Ontario 


S25 Male = Thunder Bay, Ontario. 


Parents with College Bound Children * 


Be Male - Toronto, Ontario 
34. Female - Toronto, Ontario 
35% Female - Thunder Bay, Ontario 


36. Male - Thunder Bay, Ontario. 
Parents with Work Bound Children * 


a7. Female - Thunder Bay, Ontario 
38. Male - Thunder Bay, Ontario. 


Parents whose Children have Completed Forma! Education 


39. Female - Toronto, Ontario 
Lo. Male - Thunder Bay, Ontario 
Al, Female - Thunder Bay, Ontario. 


Parent with No Children in Secondary School System 


42, Male - Toronto, Ontario. 


Adult with No Children 


43, Female - Toronto, Ontario. 


* All these parents have at least one child in Grade 12 or 13. 
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All interviews and group discussions were conducted 
between January 18, 1976 and March 235 1976.9" D1Scuss ton 
outlines for the various population groups are appended 


to this report. (See -d) Discussion Guides). 


As the above table demonstrates, a number of different 
variables were taken into account in selecting the popu- 
lation groups. The variables included are not intended 
to be exhaustive of all possible variables which might 
influence attitudes toward education and the specific 
questions related to the interface between secondary and 
postsecondary institutions, nor are the various repres- 
entatives of the characteristics set forth in the table 
considered to be representative of the larger population. 
Rather, the decision to include a number of different 
factors in selecting the persons to be included in the 
qualitative exploration was made in order to provide input 
from as many different vantage points as possible within 


the budget, not timing constraints of the study. 


Results 


The major results of the qualitative research are presented 


in the form of highlights in the following pages. 
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secondary Education 


Despite the differences in familiarity with various compon- 
ents of the educational system, and despite the various 
levels of sophistication regarding educational theory, the 
attitudes expressed by all population groups studied dis- 
play a remarkable consistency. If not otherwise specified, 
the findings presented can be applied equally well to all 


groups. - 


Regardless of their position in the educational system, 

all representatives of the teaching profession claim 
dissatisfaction with the preparation of their students. 
Thus, secondary school teachers are critical of the prepar- 
ation provided at the primary level; university and college 
teachers are critical of the preparation provided at the 


secondary level. 


Despite the criticisms expressed, most of the educators 
recognize that they would have complaints about student 
preparedness regardless of the teaching models used. This 
acknowledgement places the criticism in some perspective. 
Education is a traditional whipping post, and perhaps is 

a favorite among people who are professionally involved in 


the educational system. 


Interestingly, each group of educators is careful to place 


blame elsewhere. There is little self-criticism. 


| _ 


| 


Because more people are familiar with the secondary school 
system than either the university or community college 
systems, this strata tends to receive the most criticism. 
People, even if they have children bound for, or in, the 
post-secondary institutions, claim little understanding of 
these institutions! goals and objectives, and are not pre- 


pared to level criticism. 


This reluctance seems to be related to the pervasive 
attitude that secondary education is a requirement -- it 

is compulsory, is obviously public, and because of this 
public image, can be subjected to the public's criticism. 
Furthermore, everyone who has been through secondary school 
becomes a de facto expert on the subject. The ''advanced!', 
"'selective'’ and ''technical'' aura of colleges and universities 


contribute to their immunity from criticism. 


|t should be noted that there exists a marked disparity 
between educators and other population groups in the 
relative comfort each has in offering opinions about the 
structure and relationships of the educational system. 

Many people who are not educators are uncomfortable offering 
their opinions. This discomfort seems to derive from two 
factors -- the perception that education is a technical 
field and the ''common man'' is not the appropriate person 

to ask; and the public's tendency to react to the educat- 
jonal system rather tham reflect on it. sitive never real ly 
thought about it!'' is a characteristic reaction to many of 
educational issues raised. People are often unwilling 

or unable on such short notice to generalize from the 
problems they and/or their children experienced. Their 
responses are often anecdotal, and in the case of parents, 
are often presented as faults with the children rather 


than faults with various facets of the system. 
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The objects of criticism, for the most part, are related 

to academic qualifications of students. Deterioration of 
basic communication and mathematical skills is the 

critical issue. The teachers claim that students! abilities 
to extract the key points from readings or lectures, to 
write clearly, to develop an argument and to perform basic 
arithmetic functions are less well developed with each 


passing year. 


Students are quick to mention their deficiencies in these 
areas, and parents bemoan the fact that their children 


cannot perform these functions adequately. 


Lack of discipline is posed as a major problem as well. 
Educators and students criticize the lack of academic 
discipline -- students are not trained to pursue arguments 
even when they encounter difficulties -- whereas the 
"general public!’ expresses concern about the laxness of 
behavioral discipline in the schools. Lack of respect for 
teachers, property, etc., a desire to return to the strap, 
to bring order into the secondary institutions are fre- 


quently mentioned. 


The difference in the use of the term ''discipline!! indicates 
a fundamental difference in the perceived goals of secondary 
institutions among those people engaged in secondary or 
post-secondary education and those who are not directly 
involved. While they do not disavow the socializing 
functions of secondary institutions, the former groups 
perceive the primary function of the secondary institutions 
to be skill acquisition. The latter group is less decisive 


in its emphasis. Secondary schools should teach the basic 
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skills, or at least build on these skills, (everyone 
maintains that initial skill development in the 3 R's 
is the role of the primary school), but they also have 


an important socializing function. 


(lt is possible that in their private discussions, 
educators would place more stress on the socializing 
functions of secondary institutions than they do in 
discussions which concentrate on their ''professional!! 


lives). 


|solation of the source of deterioration reveals a fund- 
amental confusion. People are unwilling, and unable to 
isolate the source. There is a tendency to blame the 
secondary schools! curriculum, the lack of planned pro- 
grammes with required courses, the disparity in standards 
of excellence across secondary schools, and the perceived 


lack of academic discipline in secondary schools. 


These factors are facile in the sense that they represent 

a concrete change in the secondary programme, and thus are 

an obvious target for criticism. When a system does not 
produce as well as one expects, and there has been a concrete 
and recent change in this system, it is very easy to place 


blame on this change. 


At the same time, people recognize that the secondary 

school system, and the changes that have been introduced 

in recent years are, in a sense, mirrors of changes taking 
place in the society as a whole. The technological advances, 
and the popular emphasis on personal skills and psycho- 
logical well-being are filtering through the educational 
edifice. Educators recognize this to a greater extent 


than non-educators and are extremely uneasy about it. 
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They are torn between their desire to achieve and maintain 
rigid standards of academic excellence, and their desire to 


encourage the students! sense of self. 


This fundamental confusion creates an atmosphere in which 
it is very difficult for people to generate strong recomm- 
endations for modifications within the system. Any one 
statement -- be it a return to a rigid secondary programme 
or the development of more avenues for personal growth -- 
is immediately equivocated. |t seems that everyone wants 
academically well-prepared students who are full of imag- 
ination, creativity, and a heightened sense of self; and 
they do not know how to design an educational experience 


which will provide ''the best of all possible worlds''. 


Recommendations for changes in secondary institutions are 
forthcoming, nonetheless. Essentially, all groups agree 
that serious consideration ought to be given to the estab- 
lishment of a required core curriculum that would include 
first language composition, and mathematics. Tous. Cone 
curriculum should be required of all students, regardless 
of their future plans in order to ensure that everyone who 
leaves a secondary institution with a diploma is capable 

of functioning in the society, and will not have, unknow- 
ingly, closed off the option of continuing his or her formal 


training. 


There is some debate about t’'e value of grade 13 in all 
groups. Those who argue in favour of maintaining it do so 
on the grounds that an extra year of school never hurts, 
or that it gives young people another year in which to 
mature before entering the work, college or university 
world. Those who argue against the continuation of grade 


13 do so on the grounds that it is anachronistic. 
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Community Colleges And Universities 


As stated previously, there is an in-built reluctance on 

the part of most people not directly involved with CAATs 

to make comments about them. This is true not only of the 
general public and students, but also of university staff 
and students. Even those people who claim little knowledge 
of the CAATs system claim that the goal of this set of 
institutions is the provision of technical education. 

These schools offer "practical"! courses (the implication 
often being that universities offer "impractical! courses 
of study), courses that train people for jobs. Most people 
are aware that community colleges are obliged to take any 
graduate of a secondary institution in Ontario, but there 

is a sense that the ''very bright!' students do not attend 
these institutions. Instead, these students go to 
university. There is a hint of stiana attached to the 
CAATs, especially among university connected people. Des- 
pite this feeling, everyone expresses the tremendous value 
these institutions have in society. They train the workers. 
The farther removed an individual is from a university 
experience, the greater the value he or she places on 
community colleges. This tendency may derive from ignorance 
of the functions oF Universi pies sor irom. eustrongibel ler 
that universities are over-valued -- a place for "rich kids!! 


to waste time and taxpayers' money. 


The general public has a more difficult time conceptual- 
izing the roles or objectives of a university than of a 
community college. They understand universities to be 
'brofessional'' schools -- places where doctors and lawyers 
are trained. There is little understanding of the ''liberal 
arts'' education. All educators, on the other hand emphasize 
the liberal arts training goals of university undergraduate 


education. They distinguish between this form of training 
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which enhances the culture of the student and of the 
society as a whole and skill development. Universities 
are not necessarily expected to provide the latter (with 


certain exceptions such as engineering). 


For the general public the aura which keeps universities 
gomewhat immune from criticism also seems operant in 
people's reluctance to discuss goals and objectives. 
Universities, to a greater extent than community colleges 
are mysterious ''black boxes!' -- students enter on one side 
and exit on another, but there is no comprehension of what 


takes place within. 


Despite the lack of awareness among the general public, 
people in this group often agree with some of the educators 
that there is and ought to be a certain exclusivity about 


entrance to university. 


Other educators would prefer that the university experience 
be made available to everyone -- they would like to give 


everyone ''a chance to fail''. 


This difference of opinion among educators is also reflected 
in their attitudes toward remedial work. While all 
educators recognize the need, some resent the idea of 
universities and colleges being required to lower expect- 
ations and provide remedial work, Others are relatively 


indifferent to this development and accept the necessity. 


tn order to reduce the trend toward the provision of 
remedial work, people in all groups would prefer to see 
the initial training improved. Standardization of courses 
content and standards of performance are seen as necessary 


steps toward this improvement. Serious consideration was 
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also given to the re-establishment of standardized 
Provincially administered examinations. The establish- 
ment of such examinations would be of service to all 
people in the educational system and to employers. |t 
would provide bench-marks for parents and students, as 
well as for university and college educators. There is 

no desire to simply revert back to the grade 13 depart- 
mental examinations -= this form of examination is thought 
to placé unnecessary emotional strain on students. However, 
when actually called upon to make concrete suggestions, 
people seemed quite limited in their ability to recommend 


any other type of examination. 


CAAT educators recognize that performance or a standardized 
examination would not be used as a criteria for entrance, 
but feel that if they had the results of such tests they 


could better guide students. 


There seems to be a communication problem between al] 
levels of the educational hierarchy, and between the 
general public and each level. There seems to be virtually 
no communication on any systematic or institutionalized 
basis between colleges and universities, or between 
universities and the public. Most people, be they edu- 
cators or general public representatives are not particu- 


larly concerned about this lack of communication. 


Community colleges are perceived to be relatively effective 
in communicating to the secondary institutions, to students, 
to employers and to the general public. The real lack of 
communication which concerns people is between the secondary 
schools and every other level. Parents are concerned that 


they are not informed of what transpires in the secondary 
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schools. |f they were better informed, they might be in 
a better position to counsel their children. They realize 
that they can go to the schools to get information, but 
there is a strong sentiment that the school should take 


responsibility for initiating the communication. 


Educators at post-secondary institutions would prefer the 
secondary schools to find out more about their expectations 
of graduates, and display a greater interest in tailoring 
their curriculum to meet these expectations. Where commun- 
ication does exist between the secondary and post-secondary 
level, the communication issue seems to be paradigmatic of 
the interface question. The post-secondary levels are per= 
ceived by the public and educators alike to rely on the 
products of the secondary school system. Rellance charact- 
erizes the relationship between levels rather than mutual 
support, commonality of final goals, etc. Because there 

is no in-built reliance between the community colleges 

and the university systems, there is little apparent relat- 
ionship between them, and little interest in nurturing a 


relationship. 
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The Technique 


-i) About Focus Group Discussions 


The focus group discussion is an extremely useful tool in 
qualitative research. Jt entails the gathering together 
of 8-to-10 individuals, selected at random and screened 

to fulfill the requirements of the research. The group 
meets with a skilled moderator who leads the discussion. 

As the term suggests, the topic areas under discussion 
begin on a general level and as the discussion progresses, 
are focused into specific dimensions of the topic. The 
function of the moderator is to encourage open individual 
responses and facilitate group dynamics while leading the 


discussion from general to specific topic areas. 


The atmosphere of the group discussion may be its most 
important asset. Individuals are often eager to discuss 
their impressions and opinions with others. After the 
initial warming up, always required among a group of 
strangers, a very relaxed and easy conversational flow 


develops. 


Focus group discussions are especially useful in topic 
areas where the scope and nature of the public's response 
cannot be predicted. They can serve as a tool for defining 
the areas of interest, the major arguments, and the per- 
spective from which a problem is viewed. |t must be noted 
that such research cannot be interpreted with Netatist ica 
accuracy'', Rather, qualitative research is valuable for 


showing direction on basic attitudinal components. 
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About |ndividual In-Depth Interviews 


Just as focus group discussions permit the play of inter- 
actional dynamics, the individual depth interview allows 

for an extensive understanding of the attitudes and feelings 
of a single individual without the pressures of a group 
situation. The individual depth interview is an equally 
valid tool of qualitative research, though its emphasis 
tends to be more individually oriented. Thus, different 
kinds of information are generated in the individual 


interview than in the focus group discussions. 


Such interviews can be conducted in a totally unstructured 
manner, or may take the form of a more open-ended structured 


interview. 
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Discussion Guides 


Educators 


I'd like to begin by asking you to tell me, as briefly as 
you can, what you consider to be the primary purpose of a 
University/CAAT/Secondary=School education. But | want 
you to disregard, at least for the moment, how well or 
poorly this purpose is being attained. [In other words, 


tell me about the ideal world -- not the real one. 
Are there other purposes or goals? Which is (are) most 
important? Do you think this view is shared by educators 


at the CAAT/Secondary School/University level? 


And, what would you say is the primary purpose of a comm- 


unity college training? Secondary school training? Univer- 


sity training? And, what are other goals of these institutions? 


lt is possible to look at the three post-elementary levels 


as being closed systems. 1s this how you would characterize 


them? Why/why not? Does overlap exist? Where? 


What do you think the linkages between the various instit- 


utions ought to be with regard to goal setting? The 


purpose of education? Curriculum? 


And, where do the needs of labour and industry fit in? 
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We've talked generally about the organization and goals 
of the system. Now, I'd like to move to more specific 


questions. 


Would you say that standards for academic achievement have 
changed in the past ten years? Where have you noticed 
changes (which concentrations; which level in the system)? 
Why do you think there has been so much press coverage 
about lower* academic performance? Why have these changes 
occurred? Can you isolate the point in time and/or the 
place in the system where the problem starts; where 


remedial action can be taken? 


Have you attempted to communicate your concerns to others? 


Who do you go to? What kind of response do you get? 


The issues in education are tied to dollars and cents -- 
though there seem to be two opposite views held. One is 
that too much money has gone into education in Ontario 
for too small a return in terms of academic standards. 
The other is that budgets need to be expanded to provide 
an acceptable level of academic performance. How would 
you assess these views? |s public expenditure related to 
the issue of 'quality'? What would more money mean? 


Where should it go? 


How much influence do you feel you, in your position, have 


in determining priorities? Where are these decisions made? 


ree 


Now, I'd like to move on to the specific area of prepar- 


ation and admission requirements. 


What types of preparation should be provided for SSGD 
(Grade 12) and SSHGD (Grade 13) graduates? 


Should courses and programs differ for college bound, 


and university bound students, and for those not planning 


post-secondary studies? |f so, in what ways? 


What degree of uniformity should there be across secondary 


schools in the level of achievement of their SSGH (Grade 12) 


and SSHGD (Grade 13) graduates? 


-a) 


Should certain subjects be compulsory for secondary 


school graduates, and if so, which? 


Should all secondary institutions require the 
same level of achievement of their graduates in 
each subject area and if so, how should this be 


evaluated? 


Should a uniform set of performance criteria be 
established in certain key subject areas for all 


secondary school graduates? 


Should the level of achievement required of secon- 
dary school graduates differ for college bound 
versus university bound versus non-post-secondary 


bound students, and if so, what should it be in 


each case? 
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What are the present admission and placement practices of: 


-a) the colleges of applied arts and technology, 


-b) the universities? 


How do you feel about them? 
What should college and university admission policies be? 


What characteristics of applicants should be considered 


for admission purposes? 


What type of assessment procedures should be used for 
admission and placement purposes by (a) the colleges of 


applied arts and technology? (b) the universities? 


none, other than possession of SSGD or SSHGD; 


SSGD and/or SSHGD marks; 


iv interviews with post-secondary faculty; 


Vv secondary school teachers' recommendations; 


) 
) 
iit) standardized tests; 
) 
) 
vi) 


provincial examinations, etc. 


if a uniform testing program were to be implemented for the 


purpose of assessing applicants for: 


a) the colleges of applied arts and technology; 
b) the universities, 
what type of tests should be employed and who should 
administer them? 
i) Achievement tests in specific subject areas? 
) General achievement tests? 
iii) Academic aptitude tests? 
) 


Intelligence tests? 


7 : prtosnye beat all | “3 7 
niu Yong, ee a 


7 7 Urs 
2 ae 

\| ay FS — oe 
t iar => 


f i. — —_ 
} re oy or 
sa: 2 iat igueee | cpp 7 
gai): Gtbe asi 7. a 
igiie: baey 
wt mad <a 
ie 
a Ga JunT wo? tf Note Makers 221) day rte Bee 
: cae an apo! "Wala saint md 


7 « _ ‘tom. 098. wine owe! iohaMbe i 
aia eo ee a a 
: ) om - Sse Se e+) vrm@eon pom 0 an oT 
_ — IR a 
Nee o)*1see-@ mg a \e 
| ‘pions oe ; 
aii a, | Wa ps0 trap 408 STemaiee © 
Sal Ae ea TY 
7 on . 
7 ele Pa 


, & 
=. 


- 65 - 


What level of achievement in (the specified discipline 


areas) should be required for: 


a) the colleges of applied arts and technology, 


b) university entrance? 


Should all universities (and all colleges) have the same 


admission requirements? 


i) Should some SSHGD (Grade 13) graduates enter 
directly into second year university or second 


year college? 


ij) Should some SSGHD (Grade 12) graduates enter 


directly into first year university? 


How flexible are the colleges and the universities, at 
present, in giving advanced standing (and/or advanced 


placement) ? 


Should post-secondary institutions communicate regularly 
with the secondary schools concerning the progress of the 


students from those schools? 


Should makeup courses involving subject matter normally 


taught in the secondary schools be offered at: 


a) the colleges of applied arts and technology, 


b) the universities? 


Under what circumstances, if any, should there be regular 


(i.e., non-makeup) courses which are offered at both: 


a) some secondary schools and some colleges, 


b) some secondary schools and some universities? 
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20- What organizations or mechanisms exist for the co- 


ordination of courses, programs, between: 


a) the secondary schools and the colleges, 


b) the secondary schools and the universities, 


within each of the specified discipline areas? 


(ii) 


General 


ee 


Public 


What are your expectations of a secondary school graduate? 


Should different expectations and programmes be made 


available for work/college/university bound students? 


How would the programmes differ? Discuss the following 


related 


issues: 


- Should a graduate be able to go out and get a job? 


- Should a graduate have a sense of what kind of 


career he/she wants to pursue? What are influ- 


ential factors which determine career choice? 


- What about development of interpersonal skills, 


maturity, the ability to work with others, in- 


dividual initiative, self-discipline? 


- A high regard for learning? 


- The ability to think through a problem and decide 


the best way of solving it? 


- Basic language skills? 


- Knowledge of particular subjects (e.g., Canadian 


studies, literature)? 


- Any others? 
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How well do the secondary schools meet your expectations? 
Is the problem at the secondary level? Why are they 
successful/unsuccess ful? 
PROBE FOR: 
- Lack of core curriculum courses - required courses? 
- "Frivolous'' courses; 
- poor teachers; 
- general societies attitudes; is education foll- 
owing a trend in society? 
- Lowered standards; 
- no uniform expectations, e.g., standardized exams; 
- discipline (applying self; personal) ; 
- freedom of student choice in curriculum; 


- remedial training. 


Now what role do you think community colleges play? What 
is your expectation of a college graduate? Who should go 


to a community college? 


- curriculum (different/similar in any way from 


university/secondary school). 


What standards, if any, should be established for admission? 
What are the major goals of community colleges? How do 


these differ from secondary school goals? Should they? 


What role do you think universities play? What is your 
expectation of a university graduate? Who should go to 


a university? 


- curriculum (Ist year - different/similar in any 


way from community colleges/secondary schools) 
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What standards, if any, should be established for 
admission? What are the major goals of universities? 


How do these differ from secondary school goals? 


Do you think the current education levels mesh with one 


another? 


- Satisfied with system. 

- System should be changed/how? 
Departmentals, standardized tests? 
Who administers? 


- Marks are/are not satisfactory entrance requirement. 


How do you think students feel about the educational 


system? 


ls there enough communication between the three tiers; 
between the school system and the public. What about 
information explaining admissions requirements for 


university/community college. 
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Secondary School Students 


Primary Purpose/Role Of A University Education 


|deal rather than real world 

how well or poorly this is being achieved 

other purposes/goals 

most important 

primary purpose of; community college training 
secondary school training 


what other goals do they have. 


nkee Post-Elementary Levels Relationship 


are they closed systems 

why/why not 

does overlap exist 

where 

what should the linkages be for: goal setting 
purpose of education 
curriculum 


needs of labour/industry. 


Changing Standards 


perceptions of whether standards for academic achievement 
have changed in the past 10 years, 

in what way 

at what level in the system 

why have the changes occurred 

at what point in time or place in the system does the 
problem start 

what remedial action can be taken 

have you attempted to communicate your concern to others 
who 


what is the response? 
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Preparation and Admission Requirements 


- what type of preparation for Grade 12/13 
- difference for those entering: university 
college 
neither 
- should there be uniformity among secondary schools: 


- compulsory subjects/which ones 


same level of achievement/evaluation 


uniform performance criteria in key subject areas 


different level of achievement depending on where 

student is going/what. 

- what are the practices of: college of applied arts and 
technology, 

universities, 

what is your feeling, 


what should policies be? 


Future Admissions Policy 


- characteristics of applicants for admission: 
-~ assessment procedures for admission: 
none but graduates, 
marks, 
standardized tests, 
interviews with post- 
secondary faculty, 
secondary school teachers! 
recommendations, 
provincial examinations. 
= should this differ for: colleges of applied arts and 
technology, 


universities? 
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- if a testing programme: what type, 
who administers, 


achievement tests in specific 
subject areas, 


general achievement tests, 
academic aptitude tests, 


intelligence tests. 


- college of applied arts € technology versus universities 
- what level of achievement for each 
- should all institutions have the same admission requirements 


ments or should some; Grade 13 enter second year 
university, 


Grade 12 enter first year 
university. 


6- Advanced Standing And Co-Ordination 


- how flexible are universities and colleges 
- should post-secondary institutions communicate regularly 
with the secondary schools concerning students progress 
- should secondary school makeup courses be offered at: 
colleges of applied arts and 
technology 


universities. 
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Pre-Testing Of Questionnaires 


The pre-test phase of the research is an important step 
in the development of the final questionnaire. At this 
Stage, several criteria are applied to assess the via- 

bility of the structured questionnaires. These criteria 


include the following: 


a) the communication effectiveness of the question- 
naire both in terms of the respondent's ability 
to comprehend the questions anc their ability to 


adequately respond to them; 


b) the appropriateness of the interview method for 


administering the questions; 


c) the format of the questionnaire in terms of the 
presentation and layout of the questions so as 


to minimize recording errors; 


d) the length of the interview so as to combat 


respondent fatigue. 


The following summarizes the procedures followed for the 
pre-test phase of both the educator and general public/ 


student questionnaires. 


Educators 


Consideration of the optimum methodology for this popu- 
lation group took two important factors into account: 
the need to access faculty before the end of the school 
term and the recognition that the faculty groups would 


be busy with examinations and other year end duties. It 
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was thus deemed advisable to design a questionnaire which 
could be self-completed. This would allow respondents to 
self-select a period of time most convenient to them in 


which to complete the questionnaire. 


For the University faculty pre-test, Canadian Facts' field 
representatives personally visited pre-designated insti- 
tutions in order to recruit individuals to take part in 
the pre-test. For the CAAT faculty and secondary school 
teachers pre-tests, special ‘contact' persons at specific 
institutions co-operated with Canadian Facts in recruiting 
individuals for the pre-test. For each of the three edu- 
cator groups special controls were established to ensure 
that the pre-tests were conducted among faculty from var- 


ious discipline groups and with varying years of experience. 


Individuals were asked to self-complete the questionnaire. 
A special form was provided to record any problems en- 
countered with the questionnaire in terms of comprehension, 
response categories, care of recording responses. Com- 
pleted questionnaires were retrieved by Canadian Facts' 
field representatives. The following details the number of 


completed pre-tests for each of the three educator groups. 


University Faculty--15 pre-test questionnaires com- 
pleted by faculty at the University 
of Toronto (Scarborough College) 


and McMaster university. 


CAAT Faculty--9 pre-test questionnaires completed by 
faculty members at the Centennial Col- 


lege of Applied Arts and Technology. 
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Secondary School Teachers--8 questionnaires com- 
pleted by staff members 
at a secondary school in 


Mississauga. 


The pre-test findings were carefully rescreened and neces- 
sary changes and modifications to the design of the 


questionnaires were subsequently made. 


General Public And Students 


'Self-completed' questionnaires were to be distributed to 
members of the general public and students following a 
brief personal interview. Canadian Facts' field repre- 
sentatives personally installed the pre-test questionnaire 
with individuals randomly selected to take part in the 
pre-test. In order to ensure a good representation of the 
general public and students, controls were established so 
that individuals varied in terms of several pre-established 
characteristics. For the general public these character- 
istics included sex, city size (Toronto and Belleville), 
educational background, marital status, possession of 
children and status of children in the educational system. 
The controlled variables for the student pre-tests included 
sex, level in the school system (Grades 12 and 13, univer- 
sity and CAAT undergraduate levels) and community size 


(Toronto and Belleville). 


Completed pre-tests were personally picked up by Canadian 
Facts' field representatives. The total number of com- 


pleted interviews following this procedure were as follows: 
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General Public--20 self-administered pre-test 


questionnaires. 


Students--Z0 self-completed pre-test questionnaires. 


Review of the pre-test findings indicated the desirability 
of changing the interview format from self-administered to 
personal. It was felt that this change would improve the 
overall quality of information obtained for the following 


LEaSOns s 


a) A large proportion of the general public and 
secondary school students were somewhat uneasy 
responding to questions about the post-secondary 
education systems. This uneasiness stemmed in 
part from their lack of familiarity with these in- 
stitutions. It was felt that a personal interview 
setting, which provides for a good rapport between 
interviewer and respondent would be of assistance 
in overcoming the respondents initial reticence 
about commenting on the university and CAAT educa- 


tion systems. 


b) The personal interview technique allowed for a 
more 'interesting' questionnaire because a wider 
variety of questioning techniques could be em- 


ployed. 


c) It was anticipated that each of the above factors 
would contribute to a higher overall completion 


level. 
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The questionnaire was re-designed for a personal interview 
and then pre-tested. The number of completed pre-tests 


was as follows: 


General Public--10 completed personal interviews. 


Students--10 completed personal interviews. 
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INTERVIEWING PROCEDURE 
er ee ee 


Educators 


In order to inform the secondary schools, universities and 
CAATS, about the research project a public relations pro- 
gram was initiated by the Ministries. Each of the insti- 
tutions (ail of the universities and CAATs and the pre- 
selected sample of secondary schools) was sent a document 
outlining the purpose of the research and soliciting co- 
Operation. A special contact person was designated at 
each institution to liaise with Canadian Facts on any mat- 
ters pertaining to the execution of the research. An in- 
ternal memo was then circulated to Faculty members within 
each institution in order to advise them of the Study and 


the possibility of their participation in it. 


Prior to the data collection stage, a Canadian Facts! 
representative telephoned the contact person at each in- 
stitution to inform him of the dates and procedures for 


expecting the field work. 


Questionnaires were then distributed by Canadian Facts' 
representatives to the pre-selected faculty members at 
their respective institutions. In a few cases (the more 
remote areas of the northern part of the province) 
questionnaires were mailed directly to the designated 


faculty. 


Faculty members were asked to self-complete the question- 
naire within a specified period of time. Non-responders 
were followed up either in person or by telephone. Com- 
pleted questionnaires were personally picked up. Ina 
few cases questionnaires were mailed back directly to 


Canadian Facts. 
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Data collection took place during the following time 


periods: 
~- University Faculty --March 19 - End of May; 
-~ CAAT Faculty =“Kareh 29 STEnduot dunes 
~~ secondary School Teachers--May 25 = End of June. 


French versions of the questionnaire were available to 
those individuals who preferred to reply in the French 


language. 
General Public And Students 


Selected individuals were personally interviewed in their 
homes by Canadian Facts! interviewers. The interviewing 
staff was provided with a letter of introduction from the 
Ministries soliciting co-operation. The interviewing 


time ranged from 40 to 60 minutes. 


Interviewing took place during the months of July and 


August, 1976. 
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E. QUESTIONNAIRE DESIGN 
ihe Educators 


A possible source of bias in any research stems from the 
positioning, or order of presentation of the various re- 
search questions. In a self-administered questionnaire 
special steps have to be taken to compensate for this pos- 
sible source of bias. The procedure requires that several 
versions of the questionnaire are prepared each presenting 
questions or specific elements of questions in a different 
sequence. The following details the questionnaire versions 


developed for each of the three educator groups. 
-a) University Faculty 


A major portion of the questionnaire dealt with questions 
pertaining to the possible objectives of secondary school, 
university and CAAT education, and, the perceived success 
of each of these institutions in successfully meeting 
these possible objectives. The specific objectives ad- 
dressed in the questionnaire numbered eight for secondary 
school education and seven for the post-secondary insti- 
tutions. A full rotation of the order of presenting these 
specific objectives in the questionnaire was executed as 


follows: 
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Type Of Number Of 


Questions: Rotation Versions 
Objectives Of Secondary School FULL 8 
Success Of Secondary Schocl In 

Achieving Objectives FULL 8 
Objectives Of Undergraduate Schools 

Of Universities FULL ii 
Success Of Undergraduate Schools In 

Achieving Objectives FULL Hi 
Objectives Of CAATs FUEL 7 


In total 37 different versions of the questionnaire were 


prepared. 
CAAT Faculty 
The procedure for the CAAT questionnaire followed that of 


the university instrument. In total 37 different versions 


of the questionnaire were prepared. 


Secondary School Teachers 


Secondary school teachers were asked to indicate possible 
objectives and the perceived success of secondary school 
education for three classifications of students. The 
specific objectives for secondary schools addressed in the 


questionnaire numbered eight. 


The order of presenting the university and CAAT sections 
of the questionnaire were rotated so that half of the re- 
spondents evaluated universities first and half evaluated 
CAATs first. Within each of these two sections, the 
specific elements of the objective questions for univer- 


sities and CAATs was fully rotated. 
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The following details the nature and number of different 


versions prepared for the secondary schocl questionnaire. 


Number Of 

Questions: Type Of Rotation Versions 
Objectives Of Secondary School 
Education 3 (Classi fi- 

cations of stu- 

dents) x 8 (ob- 

jectives) 24 
Success Of Secondary School 
In Achieving Objectives 3 (Classitie 

cations of stu- 

dents) x 8 (ob- 

jectives) 24 


Objectives Of Undergraduate 
Schools Of Universities FULL (7) rotations 
on objectives) x 
2 (order of pre- 
senting section) 14 


Objectives Of CAAT FULL (7) rotations 
on objectives) x 
2 (order of pre- 
senting section) 14 


The total number of different versions prepared for this 


study was 76. 
General Public And Students 


The design of the general public and students study called 
for a personal interview. Many of the specific elements 
contained in many of the questions were rotated by means 
of show cards. For example, sixteen statements were de- 
veloped for the objectives question for secondary schools. 
Each of these statements was printed on a special card. 
These cards were shuffled by the interviewer and then pre- 
sented, one at a time, to the respondent. This procedure 


was followed for the following questions. 
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Secondary School Section 
Questions 2, 3,4, And /-=Shutfle: cards: 


University Section 
Questions 1, 2, And 7 =-onutt ke" cards: 


CAAT Section 
Questions I, 2, And: 7 ==Shutimtewcards:. 


In addition, the order of presenting the university and 
CAAT sections of the questionnaire were rotated with 
one-half of all respondents evaluating universities 


first and one-half evaluating CAATs first. 
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QUALITY CONTROL 


Field Verification 


Educators 


The educator portion of the research required that inter- 
viewers visit specified institutions and distribute 
questionnaires to pre-designated faculty members. After 
a specified period of time, questionnaires were picked up 
and returned to Canadian Facts. A special control code 
on the questionnaire indicated the specific institution 


to which the questionnaire was directed. 


Field verification through check-back interviews is not 
possible for self-administered questionnaires. For this 


study the following verification procedures were followed: 


i) amaster file of the pre-selected sample of 


faculty within each institution was prepared; 


ii) completed questionnaires were, in most instances, 
voluntarily signed by the respondent. Re- 
spondents names which did not correspond with 
those on the master file were classified as non- 


completions; 


iii) any completed questionnaires which were knowingly 
passed along to another faculty member to com- 
plete were rejected and classified as non-comple- 


tions. 
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General Public And Students 


A validation questionnaire was prepared for the general 
public and student studies. Questionnaires included the 
respondents' age, occupation of head of house, interview 
method (i.e., personal), a procedural question regarding 

the use of show cards and a specific question toward the end 
of the interview. A copy of the check-back questionnaire 

is available in the technical dccument, Volume Il Field 


Materials. 


One questionnaire per stint (a stint being the number of 
interviews completed in one interviewer work period) was 
checked by telephone at the local level, that is, by field 
supervisors using this validation questionnaire. A further 
telephone validation was carried out by staff members at 
Toronto Head Office. One in every twenty stints of all 
studies at Canadian Facts are 100% validated. Validation 
of specific stints for this particular study were part of 
the general procedure. The level of field validation on 


the general public and student study was 17%. 


Editing 


All interviews were edited for acceptability according to 
criteria of completeness and accuracy. Editors' checks 
included the following: patterns in coding or checking 
sequences, patterns in open-end replies, consistency of 
answers, mechanical recording errors and missing informa- 


Elomi 


Missing entries were filled in, and apparently erroneous 
entries were corrected only when the requisite information 
could be clearly and validly inferred from the existing 


entries on the questionnaire. 
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Coding 


The procedure for setting up the codes for this study was 


as follows: 


- the codes were set up by the coding supervisor in 
conjunction with the project director who gave 


final approval; 


- coders assigned to the study were personally 
briefed by the project director to ensure that 


they were familier with the study requirements; 


- since the educators tended to provide long and 
sometimes detailec ‘essay' responses to open-end 
questions a special ‘content! analysis approach 


was devised for groupine the responses; 


- the codes developed for the educator study were 
kept as comparable as possible among the three sub- 
groups, that is university faculty, CAAT faculty 


and secondary schccol teachers; 


- 100% of eligible questionnaires from the educator 
portion of the study and 75% of the general public 
and students were used as the basis for develcping 


codes. 
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Punching And Tabulation 


The tabulation plans were designed by the Project Director 


in consultation with the Ministries. 


Verification of keypunching followed standard procedures 
which ensure accuracy of punching after computer cleaning 


was less than four in every ten thousand keystrokes. 
The card cleaning process was as follows: 


- all cards were cleaned prior to or in the course of 
the tabulations, and all errors were checked back 


to the questionnaire; 


- all columns were cleaned to correct errors, missing 


and illegal punches; 


- all dependent questions were checked for answers by 


eligible respondents; 


- inter-related responses were cross-checked for con- 
sistency and corrected when (and only when) it was 


determined that this could be done with validity; 
- all card columns were single punched; 


- the single punch requirements necessitates that a 
limit be placed on the amount of information tabu- 
lated from open-ended questions. For this study, 
the first three responses to all open-end questions 


were tabulated. 
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